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19.  Abstract 

main  thrust  of  this  research  effect  has  beai  investigation  of  the  spatial  and  temporal  properties  of 
the  visual  processes  underlying  relative  spatial  localization  by  human  observers.  The  initial  tasks 
were  develq>ment  of  a  suitable  laboratory  display  system  for  genonting  the  r^uiied  stimuli,  and 
development  of  appropriate  experimental  par^gms  for  studying  the  localization  of  widely  separated 
objects.  The  second  task  was  to  make  careful  quantitative  measurements  of  the  spatial  and  tenq>oral 
properties  of  the  system  underlying  localization  of  widely  separated  objects.  It  was  found  that  many 
of  the  stimulus  manipulations  that  are  critical  in  determination  of  contrast  detection  thresholds  have 
little  or  no  effect  on  localization  accuracy.  The  relative  localization  of  widely  separated  objects  is  a 
highly  robust  visual  ability.  Those  variations  in  localization  accur^  with  changes  in  the  spatial  and 
temporal  parameters  of  the  stimulus  that  were  obtained  could  readily  be  modeled  as  natural  extensions 
of  the  threshold  properties.  The  final  task  of  this  project  was  testing  of  existing  models  of  spatial 
vision  as  they  apply  to  the  localization  problem.  We  found  that  localization  is  a  more  complex  visual 
ability  than  can  be  accounted  for  by  current  models  of  spatial  vision.  Specific  extensions  of  the 
existing  model  were  suggested  by  the  data. 
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L  Research  Objectives 

The  aim  of  the  research  covered  by  this  contract  was  to  study  the  pro^ss  underlying  the 
relative  spatial  localization  of  widely  separated  objects.  (The  localizati<»i  of  widely  separated 
objects  subs«iuently  be  referred  to  as  macrolocalization.)  Specifically,  the  pnmaiy  research 
was  conducted  on  the  following  topics: 

•  The  role  of  eye  movements  in  macrolocalizatiorL 

•  The  relationship  between  macrolocalization  and  the  localizatitm  of  objects  that  are 
separated  by  only  a  few  minutes  of  arc  -  i.e.  hyperacuity  targets. 

•  The  spatial  and  temporal  prc^)erties  of  the  process  underlying  macrolocalization,  with 
specif  attention  to  die  irr^lKatirais  of  die  results  of  this  research  for  models  of 
localization  and  for  understanding  the  relationship  between  macrolocalization  and  other 
spatial  visual  abilities. 


n.  Laboratory  Facilities 

Under  this  craitract  a  flexible  computer-controlled  display  system  was  designed  and  built  in 
the  principal  investigator's  laboratory  at  SRI.  The  s^tem  is  ba^  on  an  Apple  n  computer.  The 
Apple  n  controls  the  details  of  the  experiment,  specifying  the  parameters  for  the  stimuli,  recording 
data,  calculating  the  next  stimulus  value  in  stmrcase  arid  adjustment  procedures,  randomizing 
stimu^  and  giving  right/wrong  feedback  to  the  subject  A  680(X)  cq;>rocessOT  residing  in  the  Apple 
is  dedicated  to  sending  visual  pattern  information  to  special-purpose  hardware  consisting  of  a 
hardware  frame  buffer  and  an  aiudog  board  that  generates  the  video  signals  required  by  the  Conrac 
(2400C19)  display  monitor.  Hus  arrangement  gives  us  a  high  degree  of  flexibility  while  being 
fast  enough  to  switch  from  one  pattern  to  a  totally  different  one  during  the  vertical  retrace  of  the 
display. 

The  display  field  is  512  by  5 12  pixels,  refreshed  60  times  per  second,  non-interlaced.  Each 
pixel  is  controlled  by  an  8-bit  lumiruuice  value  and  a  12-bit  contrast  modifier.  However,  each  line 
of  the  display  is  restricted  to  just  two  gray  levels  in  three  sequential  segments:  background, 
foreground,  background.  This  is  adequate  for  displaying  a  large  assortment  of  points,  lines,  bars 
and  gratings,  and  greatly  reduces  the  information  baiidwidth  requirements  of  most  of  the  system. 

In  this  system,  stimuli  are  described  in  a  converuent  and  |wwerful  language  created 
specifically  for  this  task.  The  patterns  include  time  as  a  dimension,  specifying  frame-by-frame 
changes  of  contrast  or  position,  which  may  be  repeated  cyclically. 


nL  Research 
A.  Initial  Work 

While  developing  the  laboratory  facilities  described  above,  the  principal  investigator  did 
collaborative  work  with  Dr.  D.  Regan'of  Dalhousie  University,  Nova  Scotia.  Several  lines  of 
research  were  pursued: 

•  Temporal  characteristics  of  the  discrimination  of  objects  on  the  basis  of 

hue  differences.  We  found  that  discrimination  is  severely  impaired  in  the  absence  of 
retinal  image  motion  in  all  except  tte  yellow  region  of  the  spectrurrt  This  research  was 
reported  at  ARVO  in  1983. 

•  Independence  of  orientation  and  spatial  frequoicy  in  suprathreshold 
discriminations.  This  was  our  primary  research  effort  It  will  be  discussed  in  more 
detail  subsequently. 

•  Masking  of  spatial  frequency  disoimination.  Results  of  the  earlier  studies  on 
sup^thr^hold  discrimination  suggested  that  the  effects  of  masking  on  frequency 
di^rimination  should  also  be  explored.  Prelimin^  experiments  revealed  that  whereas  an 
orthogonal  mask  has  no  effect  on  frequency  discrimination,  a  parallel  mask  has  a 
profound  effect  which  varies  with  the  relative  spatial  frequencies  of  the  mask  and  test 
gratings.  Dr.  Regan  completed  this  research  in  his  laboratory,  under  his  AFOSR 
contract 


B.  Independence  of  Orientation  and  Spatial  Frequency  in  Suprathreshold 

Discriminations 

Several  popular  models  of  frequency-disoimination  and  of  orientation-discrimination 
postulate  that  discriminability  is  a  simple  Action  of  the  difference  in  the  responses  of  frequency- 
and  orientation-tuned  channels  to  die  two  stimuli  being  compared.  In  these  models,  the  response  of 
a  given  channel  to  the  first  stimulus  is  subtracted  from  the  response  of  that  channel  to  the  second 
sdmidus.  Discriminability  is  then  a  simple  function  of  the  differences  found  in  all  of  the  postulated 
charmels. 

Dr.  Regan  and  I  tested  these  models  by  measuring  frequency  discrimination  thresholds  with 
like-oriented  and  with  orthogonsd  grating  pairs,  and  measuring  (mentation  discrimination  thresholds 
wi  A  grating  pairs  of  die  same  spatial  frequency  and  of  very  deferent  spatial  frequencies.  The 
above  models  make  no  direct  predictions  about  the  results  of  these  experiments,  but  they  strongly 
suggest  that  discrimination  th^holds  should  be  impaired  by  the  introduction  of  large  differences  in 
the  dimension  that  is  irrelevant  to  the  task  being  perftmned.  We  found  that  there  were  no  such 
differences.  Orientation  and  frequeiKy  are  inclqiendent  at  this  discrimination  stage  of  visual 
piocessing.  These  results  suggest  that  units  with  similar  spatial  frequency  characteristics  but 
(Afferent  orientation  preferences  are  linked  and  that  units  with  similar  orientation  preferences  but 
different  spatial  frequency  characteristics  are  also  linked.  This  linking  is  not  evident  in  the  results 
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either  pattern  adaptation  <x  masking  studies,  but  it  is  consistent  with  our  hypothesis  that 
discrimination  occun  at  a  stage  of  visual  processing  sub^uent  to  the  initial  representation  by 
spatially-localized  frequency  and  orientadcm  selective  units. 

Results  of  these  experiments  were  reported  in  a  paper  in  JOSA  in  1984. 


C.  Early  Work  on  Spatial  Localizatitm  of  Widely  Separated  Objects 

With  the  assistance  of  a  part-time  lab  assistant,  the  principal  investigatCHr  began  the  study  of 
macrolocalization.  The  first  studies  in  our  new  laboratory  focused  on  identifying  appropriate 
measurement  teclmiques.  Odier  d\an  the  research  done  in  our  lalxMratory,  thne  is  almost  no 
literature  on  Ae  subjMt  of  relative  spatial  localization  of  objects  that  are  separated  by  mcxe  than 
about  10  or  20  minutes  of  arc,  so  there  were  no  established  experimental  procedures. 

We  found  that  macrolocalization  accuracy  is  not  p^cularly  sensitive  to  the  spatial 
conflguratitm  of  stimuli,  but  that,  because  of  resolution  limits  and  local  spatial  interactions,  some 
configurations  are  ins^ropriate  for  use  as  small-scale  stimuli,  and  hence,  not  suitable  for 
experiments  that  compare  macrolocalizatitm  and  microlocalization  directly.  We  also  found  that 
measurement  of  the  temporal  and  spatial  characteristics  of  macrolocalization  requires  extreme 
precision,  txMh  because  sensitivity  is  very  high  and  because  extraneous  cues  can  be  readily  used  by 
the  subject 

We  soon  gained  sufficient  experience  with  our  expoimental  paradigms  that  we  were 
confident  of  the  generalizability  and  reinodacibility  of  our  results.  We  also  replicated  several 
microlocalizaticm  experiments  and  obtained  results  comparable  to  those  report  in  the  literature, 
indicating  that  our  experimental  procedures  were  comparable,  except  in  scale,  to  those  used  in  other 
laboratories. 


D.  Spatial  Characteristics  of  Macrolocalization-  Effect  of  Mean 

Separation 

To  provide  a  baseline  for  comparing  the  properties  of  micro-  and  macrolocalization  and  to 
guide  the  development  of  our  model  of  localization,  we  measured  localization  accuracy  with  object 
separations  ranging  from  less  than  2  to  more  than  400  minutes  of  arc  (min  arc),  using  a  3-bar 
stimulus  similar  to  that  described  above.  We  initially  found  that  locali^on  accuracy  varies 
systematically  with  object  separation  in  a  manner  that  suggests  the  existence  of  seve^  underlying 
mechanisms,  each  tun^  to  a  different  range  of  s|»tial  separations.  However,  that  result  was 
obtained  only  in  the  absence  of  feedback.  With  right/wiong  feedback  suppli^  perfcxmance  was 
iq>ptDximately  constant  with  separation  and  equal  to  the  highest  level  of  sensitivity  obtained  without 
fe^back. 

One  interpretation  of  these  results  is  that  the  systematic  variation  in  sensitivity  without 
feedback  reflects  die  presence  of  several  underiying  mechanisms,  but  that  with  feedback  the  subject 


learns  to  make  better  use  of  the  available  infonnation  in  the  regions  of  transition  between  the 
mechanisms.  Another  interpretation  is  that  performance  varies  because  of  interference  fix>m  other 
visual  processes,  which  are  themselves  spatially  tuned,  and  that  the  subject  learns  to  ignore  these 
sources  of  interference  when  given  appropriate  feedback.  With  both  of  these  interpretations 
possible,  one  can  draw  no  inferences  from  these  data  about  the  distinctness  of  different  underlying 
processes. 

The  main  Hnding  of  this  research  was  that,  when  expressed  as  a  fraction  of  the  mean 
separatitm,  localization  accuracy  is  nearly  constant  across  object  separations.  That  is,  the  "Weber 
fin^tion  for  localization".  As/s,  where  s  is  the  separation  between  the  objects,  is  essentially  constant 
wi  A  s.  This  result  has  profound  implicatitms  for  models  of  localization. 


E.  Spatial  Characteristics  of  Macrolocalization-Number  of  Bars 

We  measured  relative  spatial  localizadtm  accuracy  with  2-  and  4'bar  stimuli  over  a  large 
range  of  object  separations,  as  had  been  done  with  the  3-bar  stimuli  described  above.  In  the  2-bar 
condition,  the  subject  learns  a  standard  separadtm  and  does  a  mental  comparison  of  the  stimulus 
with  that  standard.  In  the  3-  and  4-bar  conditions  there  is  no  standard;  the  subject  compares  the 
distance  between  one  pair  of  lines  with  the  distance  between  a  different  pair. 

There  were  several  reasons  for  making  these  measurements:  1)  to  test  the  generality  of  the 
results  obtained  with  3  bars,  2)  to  investigate  the  problem  of  how  the  observer  encodes  the  distance 
between  objects,  3)  to  investigate  whether  a  frequency-domain  description  of  the  localization 
system  is  appropriate. 

We  found  that  at  all  object  separations  tested,  the  number  of  bars  has  little  effect  on 
localization  accuracy.  Apparently,  the  mental  representation  of  the  standard  separation  is  as 
accurate  as  a  real-time  judgment.  These  data  provide  evidence  that  1)  our  experimental  task  is  not 
sensitive  to  the  details  of  die  stimulus  configuration,  2)  an  observer  can  calculate  and  store  an 
average  distance  between  two  objects  with  extreme  accuracy,  and  3)  since  accuracy  is  not  improved 
by  the  addition  of  more  bars,  no  support  is  provided  for  a  frequency-domain  representation. 
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These  results  are  being  included  in  a  paper  comparing  localization  with  large  and  with  small 
object  separations.  This  paper  is  nearly  complete  and  will  soon  be  submitted  to  Journal  of  the 
O^cal  ^iety  of  America. 


F.  Temporal  Characteristics  of  Macrolocalization-  Stabilization  and 

Motion  Effects 

We  measured  the  effects  of  retinal  image  stabilization  on  macrolocalizadon  accuracy  with  a 
stationary  stimulus  and  found  that  thresholds  are  elevated  by  nearly  a  factor  of  two.  We  also 
measured  macrolocalization  accuracy  with  stabilized  and  unstabiliz^  stimuli  that  were  1)  drifted 
very  slowly  (approximating  the  nau^  drift  rate  of  the  eye),  2)  drifted  more  rapidly,  or  3)  moved 
abruptly  betwc^  two  retinal  locations  once  evoy  half  sectmd.  We  found  that  macrolocaUzation 
accuracy  is  essentially  normal  with  fast  drifts  and  abrupt  shifts,  but  is  much  poorer  when  the  retinal 
image  moves  very  slowly  (stabilized  widi  very  slow  stimulus  drift)  or  is  static  (stabilized  with  no 
stimulus  motion). 

Very  slow  drift  of  the  otherwise  stabilized  stimulus,  which  restores  ctxitrast  sensitivity  to 
normal  (Kelly,  JOSA,  1340, 1979),  fails  to  restore  localization  accuracy  to  nmmal.  This  implies 
that  the  effect  of  stabilization  on  macrolocalization  is  not  due  simply  to  a  lowering  of  the  apparent 
contrast  of  the  stimulus.  We  confirmed  this  conclusion  by  measuring  localization  accuracy  with  an 
unstabilized  stimulus  whose  apparent  contrast  was  substantially  lower  than  that  of  the  ori^nal 
stabilized  stimulus.  This  large  change  in  contrast  had  little  if  any  effect  on  macrolocalization 
accuracy.  Thus  the  loss  of  apparent  contrast  diat  results  from  stabilization  of  the  retinal  image 
(Burbeck  and  Kelly,  JOSA,  216, 1984)  could  not  account  for  the  decline  in  macrolocalization 
accuracy.  Accuracy  must  have  been  r^wred  because  of  the  temporal  tuning  of  the 


macrolocalization  process  itself. 


The  effects  of  stabilization  on  macrolocalization  are  different  from  the  effects  on 
microloc^zadon  that  have  been  report  previously  by  Keesey  (JOSA,  769, 1960).  However, 
comparison  between  these  two  findings  may  not  be  meaningful  bwause  the  quality  of  image 
stabUization  required  for  the  microlocalizadon  stimuli  is  probably  not  achievable  in  pracdce.  Thus, 
the  null  result  that  Keesey  obtained  in  the  microlocalizadon  condidon  may  have  been  artifactual. 
Because  of  these  potend^  artifacts,  we  adopted  a  different  paradigm  for  comparing  the  temporal 
properties  of  small  and  large  scale  localization. 


G.  Temporal  Characteristics  of  Localization-Exposure  Duration 

We  investigated  the  effects  of  exposure  duration  on  localization  accuracy  over  a  wide  range 
of  object  separations.  In  this  experiment,  the  subject  was  presented  with  a  stimulus  consisting  of 
two  identic^,  parallel,  horizon^  bars.  The  observer's  ta^  was  to  determine  whether  the 
separation  between  tire  bars  was  more  or  less  than  the  average  object  separation  he  had  seen  on 
previous  trials.  The  stimuli  were  presented  for  100  ms,  400  ms,  or  for  an  indefinite  duration 
(stimulus  terminated  by  the  observer's  response);  localization  thresholds  were  measured  for  the 
three  temp(»al  conditions,  for  several  mean  object  separations  ranging  from  6.7  to  400  minarc. 

Results  for  two  observers  are  shown  below.  Localization  accuracy  declines  with  decreasing 
exposure  duration  at  the  smallest  mean  separations  used,  consistent  with  previous  studies  of  the 
effects  of  exposure  duration  on  hyperacuity  (e.g.,  Baron  and  Westheimer,  JOSA,  212, 1973). 
However,  for  mean  separations  larger  than  about  25  minarc,  exposure  duration  has  no  effect  after 
100  msec.  (At  exposure  durations  less  than  100  msec,  contrast  integration  plays  a  major  role  in  the 
results.) 


with  a  frequency-channel  model  of  relative  spatial  localization  in  which  hypeiacuity  stimuli  are 
localized  by  high  spatial  frequency  mechanisms  and  more  widely  separate  stimuli  by  low  spatial 
frequency  mechanisms.  To  test  this  spatial  frequency  channel  model  of  localization,  we  repeated  the 
exposure  duration  experiments  with  a  pair  of  widely  separated,  high-frequency  bars.  Each  bar 
consisted  of  a  high  frequency  grating  whose  ccmtrast  was  modulated  by  a  Gaussian  envelope.  The 
frequency  of  the  gratings  was  22  cycles/degtee,  and  8  cycles  of  the  grating  were  visible  to  the 
observer  under  the  Gaussian  envelope.  Results  for  this  condition  were  similar  to  those  obtained  in 
the  7  minarc  condition,  even  though  the  bars  were  separated  by  175  minarc:  Localization  accuracy 
for  the  high  frequency  bars  was  significantly  impaired  at  both  100  and  400  msec  relative  to  the 
steady  state  condition.  We  concli^ied  that  Ae  exposure  duration  effects  occur  at  a  stage  of  visual 
processing  that  is  distal  to  the  site  of  the  localization  judgment,  and  further  that  localization  of 
widely  separated  objects  is  not,  in  general,  perfcamed  by  low  spatial  frequency  mechanisms. 

That  the  exposure  duration  effects  shown  above  were  not  simply  contrast  effects  was  verified 
in  the  following  experiments. 


H.  Contrast  Effects  and  Frequency  Channel  Models  of  Localization 

In  this  project,  we  were  interested  in  determining  the  effects  of  contrast  on  macrolocalization. 
As  a  first  step  in  this  determination,  we  measured  both  macrolocalization  accuracy  and  the 
{x-obability  of  detection  as  functions  of  stimulus  contrast,  using  a  2-bar  stimulus  with  a  mean 
separation  of  175  min  arc.  Stabilization  was  used  to  control  retinal  location  of  the  stimulus,  and 
brief  presentations  were  used  to  minimize  fading. 

Localization  accuracy  is  not  readily  measurable  at  the  detection  threshold  because  on  most 
trials  only  one  bar  is  detect^.  At  1.5  times  the  detection  threshold,  both  bars  were  detectable  on 
most  trials,  so  localization  accuracy  could  readily  be  measured  at  that  contrast  and  higher.  We 
found  that  localization  accuracy  improves  steadily  as  stimulus  contrast  is  increased  from  1.5  times 
to  5  to  10  times  threshold.  (This  is  a  lower  range  of  contrasts  than  was  used  in  the  experiments  on 
the  effects  of  stabilization.)  We  also  performed  comparable  experiments  with  raised  sine  bars, 
which  have  less  energy  at  high  spatial  frequeiteies  th^  do  the  bars  with  rectangular  profiles  that 
were  originally  used.  The  results  were  unchanged,  demonstrating  that  the  increase  in  localization 
accuracy  with  contrast  is  not  due  to  high-frequency  information  becoming  suprathreshold  with 
increasing  contrast,  as  has  been  suggested  for  hyperacuiy  targets  (e.g.  Carlson  and  Klopfenstein, 
JOSA,  1747, 1985).  A  control  was  also  run  in  which  the  width  of  the  rectangular  bars  was 
reduced  to  be  more  comparable  to  the  perceived  width  of  the  raised  sine  bars.  These  data  are 
shown  in  Fig.  3  below. 


I 


O-  Solid  Bars  -  full  width 
Raised  Sine  Bars 


Contrast  -  multipies  of  threshold 
Fig.  3 


To  assess  the  effects  of  contrast  in  the  exposure  duration  results  and  to  test  further  the 
frequency  channel  model  of  localization,  we  measured  localization  accuracy  as  a  function  of 
stimulus  contrast  for  bars  consisting  of  many  cycles  of  a  horizontal  high  spatial  frequency  (with 
either  a  square  or  Gaussian  vertical  contrast  envelope),  and  also  with  a  white  bar/black  bar  pair. 
None  of  these  manipulations  affected  the  shape  of ‘Jte  localization  accuracy  vs.  contrast  curve. 
(Localization  accuracy  for  the  high  spatial  frequency  bars  'vith  Gaussian  envelope  could  be 
measured  only  over  a  very  limited  range  of  contrasts  because  of  the  high  contrast  detection 
thresholds  for  these  stimuli.)  We  found  that  macrolocalization  accuracy  increased  with  stimulus 
contrast  (expressed  as  multiples  of  the  contra..;  detection  threshold  for  each  stimulus)  in  the  same 
way  for  dl  stimuli  used.  However,  the  curves  fw”  the  high  frequency,  Gaussian-envelope,  bars 
were  shifted  down  relative  to  the  other  curves.  This  overall  shift  indicates  that  the  exposure 
duration  effects  reported  above  were  not  contrast  effects,  but  were  specific  to  the  temporal 
dimension. 

At  full  contrast,  with  a  longer  exposure  duration  (subject  terminated  trial),  localization 
accuracy  was  essentially  as  high  for  the  Gaussian  modulat^,  high  spatial  frequency  bars  as  it  was 
for  the  rectangular  bars.  A  frequency  channel  model  of  localization  could  not  account  for  this 
result:  The  low  spatial  frequency  chWels  tl^retically  responsible  for  the  localization  of  widely 
separated  objects  such  as  these  could  not  detect  the  high  fn^uency  bars.  On  the  other  hand,  a 
position  model  of  localization,  which  could  account  for  our  ability  to  localize  these  objects,  predicts 
that  localization  accuracy.  As  is  independent  of  the  separation  between  the  objects,  s,  contra^  to  the 
observed  relationship  (as  reported  above).  Thus,  neither  a  frequency  channel  model  or  a  position 
model  can  account  for  all  of  the  observed  results.  This  is  an  important  observation  because  it 
requires  substantial  modifications  or  extensions  of  existing  theories. 


Fig.  5 


Further  evidence  against  the  frequency  channel  model  of  localization  is  shown  in  Fig.  5.  We 
know,  from  the  results  presented  above,  that  localization  accuracy  is  an  approximately  constant 
fraction  of  the  object  sq)aration.  Therefrae,  if  localization  were  being  performed  by  frequency 
channels,  then  clinging  the  polariQr  of  one  bar  should  halve  the  peak  spatial  frequency  of  the 


responsible  channel,  and  hence  double  As.  It  does  not;  instead,  localization  accuracy  is  essentially 
unaffected  by  this  manipulation  of  the  stimulus. 

Finally,  a  slightly  curious  aspect  of  the  data  shown  in  Figs.  3-5  is  that  the  localization 
threshold  is  independent  of  the  form  of  the  bar  only  if  the  stimulus  contrast  is  divided  by  the 
detection  threshold  (that  is,  if  contrast  is  expressed  as  a  multiple  of  the  contrast  detection 
threshold).  Although  there  is  nothing  novel  about  using  the  contrast  threshold  as  a  normalizing 
constant,  the  procedure  does  assume  that  the  gain  of  the  system  is  proportional  to  the  threshold, 
and  we  have  no  independent  evidence  that  this  is  true. 

To  verify  our  previous  findings  that  exposure  duration  has  a  larjge  effect  at  small  separations 
but  not  at  large,  we  measured  locali^don  accuracy  as  a  function  of  stimulus  contrast  over  a  wide 
range  of  object  separations,  using  a  225  n^ec  flash,  as  in  the  experiments  just  described.  Results 
are  shown  in  Fig.  6.  The  pattern  of  results  at  all  object  separations  tested  (down  to  7  minarc)  is  the 
same  as  that  shown  in  Figs.  3-5.  At  the  smallest  object  separation,  the  localization  vs.  contrast 
curve  was  uniformly  shifted  down  to  lower  accuracies,  in^cadng  that  localization  accuracy  in  this 
brief  presentation  condition  is  lower  at  a  small  than  at  large  object  separations,  independent  of  the 
stimulus  contrast  This  result  is  consistent  with  a  channel  model  of  localization.  (Although  we 
have  seen  above  that  such  a  model  is  inadequate  in  other  respects.) 


Contrast  -  multiples  of  threshold 
Fig.  6 

The  results  reported  above  are  being  included  in  a  paper  on  the  properties  of  large-scale 
localization  that  is  about  to  be  submitted  to  Journal  of  the  Optical  Society  of  America 
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1.  Effect  of  Orthogonal  Extent 


In  this  set  of  experiments,  we  addressed  the  problem  of  how  the  macrolocalization  system 
calculates  distances  between  objects.  Because  As/s  is  constant,  the  shortest  distance  between  two 
objects  will  provide  the  most  accurate  information.  Can  the  macrolocalization  system  rind  and  use 
this  shortest  distance?  To  address  this  question,  we  measured  localization  accuracy  with  S  stimulus 
configurations.  In  each  configuration  there  were  two  targets,  which  were  separated  by  a  variable 
distance  vertically  (100  min  arc  average).  The  subject’s  task  was  to  judge  whether  the  vertical 
separation  was  greater  or  less  than  the  average  separation.  The  upper  target  was  always  a  small  (4 
min  arc)  dot  that  was  centered  horizontally  on  the  screen.  The  lower  target  was  either  another  small 
dot  that  was  centered  horizontally,  a  48  min  arc  line  whose  left  end  point  was  centered  horizontally, 
a  48  or  170  min  arc  line  that  was  centered  horizontally,  or  a  line  whose  length  and  position  varied 
randomly  from  trial  to  trial,  with  the  constraint  that  some  portion  of  the  line  must  lie  on  the  same 
vertical  axis  as  the  upper  target  (the  dot).  These  stimuli  were  chosen  to  vary  the  amount  of 
information  available  to  the  subject  about  the  location  of  the  orthogonal  line  connecting  the 
stimuli— from  very  high,  in  the  two  dot  condition,  to  very  low,  in  the  random-line-length  condition. 

We  found  that  none  of  these  stimulus  manipulations  signiricantly  affected  the  subject's 
performance.  Under  all  conditions,  the  subject  was  able  to  determine  the  distance  between  the 
targets  with  the  same  high  degree  of  accuracy. 

We  were  somewhat  surprised  by  this  independence  of  macrolocalization  accuracy  and 
orthogonal  extent.  To  determine  whether  this  was  a  general  result  or  was  specific  to  the  horizontal 
and  vertical  orientations  used,  we  repeated  the  experiments  at  45  degrees,  using  a  dove  prism  to 
rotate  the  imag;^  of  the  display.  A  circular  surround  and  darkened  room  were  used  to  eliminate 
extraneous  orientation  cues.  We  obtained  tire  same  results.  Again,  the  subject  had  no  difficulty  in 
determining  the  most  appropriate  direction  of  measurement;  his  performance  was  as  good  with  a 
dot  and  a  line  of  variable  length  and  position,  as  it  was  with  two  dots. 

These  results  led  to  the  next  set  of  experiments.  Both  sets  of  data  are  being  written  up  by  the 
principal  investigate  in  a  paper  on  the  effect  of  the  ethogonal  dimension  in  macrolocalization. 
(This  wek  was  delayed  by  Ae  need  to  get  a  complete  set  of  data  on  a  second  observer.  Those 
measurements  have  recentiy  been  completed.) 


J.  Effect  of  Orthogonal  Position  on  Macrolocalization  Accuracy 

Given  the  excellence  of  the  subject's  performance  in  the  experiments  described  above,  we 
decided  to  determine  the  extent  to  which  he  could  ignore  variation  in  the  position  of  the  stimulus  in 
the  direction  orthogonal  to  the  one  of  interest  For  simplicity,  we  will  refer  to  the  direction  along 
which  the  subject  is  to  judge  distance  as  the  principal  orientation,  and  the  direction  <»thogonal  to  the 
principal  orientation  as  the  orthogtmal  orientation.  In  this  expmiment  we  used  two  dots  so  that  the 
stimulus  itself  did  not  specify  the  orthogonal  mentation.  The  distance  between  the  dots  in  the 
principal  direction  was  one  of  14  values,  7  less  than  the  average  and  7  greater  than  the  ave^e 
distance.  The  subject's  task  was  to  indicate  vdiether  the  distance  between  the  dots  in  the  principal 


direction  was  greater  or  less  than  the  average.  Macrolocalization  accuracy  was  measured  by  the 
method  of  constant  stimuli  as  in  previous  experiments. 

In  the  control  experiment,  the  dots  were  simply  aligned  along  the  principal  orientation  (as 
they  were  in  the  previous  experiments),  whereas  in  the  test  experiments,  one  dot  was  also 
randomly  offset  relative  to  the  other  along  the  orthogonal  orientation.  The  extent  of  the  orthogonal 
displacement  varied  randomly  from  trial  to  trial  in  the  range  from  0  to  approximately  20  times  the 
maximum  test  As  in  the  principal  orientation.  Thus,  the  variation  in  position  in  the  orthogonal 
direction  was  much  larger  than  the  variation  in  position  m  the  principal  direction.  The  subject's 
task  was  to  ignore  the  variation  in  the  ordK>gonal  direction  and  to  determine  whether  the 
distance  between  the  objects  in  the  principal  direction  was  greater  or  less  than  the  average  that  he 
had  seen  on  previous  trials. 

Data  were  collected  fcx*  both  test  and  control  conditions,  in  interleaved  runs,  at  7  orientations 
(obtained  with  a  dove  prism):  0, 15, 30, 45, 60, 75  and  90  degrees.  A  circular  surround  and 
darkened  room  were  again  used  to  eliminate  any  other  cues  to  orientation. 

Data  for  the  two  observers  are  shown  in  Figs.  7  and  8.  We  found  that  subjects  are 
remarkably  good  at  ignoring  the  effects  of  the  orthogonal  displacement  The  ratio  of  localization 
threshold  with  and  without  orthogonal  displacement  averag^  1.49  for  one  observer,  and  2.57  for 
the  other.  Furthermtxe,  in  neither  the  centered  nw  the  random-oithogonal-displacement  condition 
was  there  any  systematic  variation  in  sensitivity  with  orientation.  Thus,  there  was  also  no 
systematic  variation  in  the  effect  of  the  orthogonal  displacement  with  orientation.  Subjects  could 
determine  the  principal  direction  with  approximately  ^ual  accuracy  at  all  orientations  measured. 
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Fig.  8 

We  concluded  that  the  macrolocalization  system  is  sensitive  to  orientation,  but  has  no 
prefened  cmentation.  The  ability  to  ignore  variation  of  position  in  the  orthogond  dimension 
accounts  for  the  insensitivity  of  the  macrolocalization  system  to  the  orthogonal  extent  of  objects, 
and  thus  begins  to  explain  how  this  system  can  achieve  such  a  high  degree  of  accuracy  with 
spatially  extended  objects. 

These  data  also  fit  in  well  with  the  type  of  model  of  spatial  localization  that  was  required  to 
account  lor  the  previous  results.  We  jmstulate  that  localization  of  widely  sei^ted  objects  does 
not  occur  in  the  retinoto^c  representation  that  has  been  extensively  modeled  in  terms  of  units  that 
are  coarsely  tuned  to  (mentation  and  spatial  frequency.  Rather  it  (x:curs  at  a  sub^uent  stage  in 
which  the  representation  is  more  symbolic.  We  hypothesize  that  a  primary  function  of  this  stage  of 
visual  processing  is  to  introduce  fundamental  invariances,  such  a  size  constancy  (see  below)  and 
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relative,  rather  than  absolute  retinal,  position. 


K.  Frequency  Discrimination,  Channels,  and  Size  Constancy 

The  experiments  repeated  above  provide  strong  evidence  that  relative  spatial  localization  of 
widely  separated  objects  cannot  be  accounted  in  the  primary  representation  (which  consists  of 
spatial  fr^uency  and  orientation-selective  units),  but  requires  significant  subsequent  processing, 
'ntis  subsequent  stage  of  basic  spatial  processing  is  also  required  to  account  for  the  results  of 
experiments  recently  perfenmed  m  the  relatitmship  between  size-constancy  and  fiequency-chaimel 
models  of  frequency  discriminatitm. 

Current  models  of  frequency  discrimination  postulate  that  the  discrimination  is  based  directly 
on  the  responses  of  units  in  Ae  primary  representation  that  are  tuned  to  specific  retinal  spatial 
frequencies.  We  tested  these  models  in  the  following  manner.  Rather  than  using  a  single  display 
screen,  we  used  two  displays  and  presented  the  gratings  to  be  compared  at  different  distances  from 
the  observer,  as  shown  in  Fig.  9. 


Under  these  conditions,  observers  do  not  match  the  retinal  spatial  frequencies,  but  rather 
make  an  approximate  match  of  the  objective  spatial  frequencies,  that  is,  they  attempt  to  match  the 
properties  of  the  stimuli,  not  of  their  retirud  images.  This  simply  is  another  way  of  saying  that  the 
well-known  phenomenon  of  size  constancy  hol&  in  the  laboratory  with  sine  wave  gratings,  just  as 
it  does  in  more  complex  environments.  However,  these  experiments  set  the  stage  for  the  important 
finding.  We  attempted  to  teach  observers  to  compare  the  retinal  spatial  frequencies  of  the  stimuli, 
ignoring  the  depth  information.  There  was  no  evidence  that  they  could  mate  this  judgment: 
Comparison  was  always  made  on  the  basis  of  the  objective  frequencies.  Observers  performed  no 
better  when  the  retinal  spatial  ftequencies  fxovided  directly  useml  information  than  when  they  did 
not  It  appears  that  obs^ers  do  not  have  direct  access  to  the  retinal  spatial  frequency  information. 
Instea^  the  retinal  frequency  information  is  transformed  into  estimates  of  objective  frequency  at  a 
site  prior  to  the  stage  at  which  the  observer  makes  his  comparison.  If  this  result  is  true  in  the 
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equidistant  case  as  well,  frequency  discrimination  data  always  include  the  effects  of  that 
transformation.  Theiefcxe,  our  finding  may  have  serious  ramifications  for  current  models  of 
frequency  discrimination. 


A  repcnrt  of  the  research  done  to  date  on  this  subject  was  presented  at  the  OSA  meetings  in 
Washington,  D.C.  in  October  of  this  year.  A  paper  reporting  these  frndings  was  also  recenUy 
submitt^  to  Journal  of  the  Optical  S<^ety  of  America. 
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